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Weighted Consensus with Linear Objective Maps 


Xudong Chen, M.-A. Belabbas and Tamer Ba§ar 


Abstract 

A consensus system is a linear multi-agent system in which agents communicate to reach a so-called 
consensus state, dehned as the average of the initial states of the agents. Consider a more generalized 
situation in which each agent is given a positive weight and the consensus state is defined as the weighted 
average of the initial conditions. We characterize in this paper the weighted averages that can be evaluated 
in a decentralized way by agents communicating over a directed graph. Specifically, we introduce a linear 
function, called the objective map, that dehnes the desired hnal state as a function of the initial states 
of the agents. We then provide a complete answer to the question of whether there is a decentralized 
consensus dynamics over a given digraph which converges to the final state specified by an objective map. 

In particular, we characterize not only the set of objective maps that are feasible for a given digraph, but 
also the consensus dynamics that implements the objective map. In addition, we present a decentralized 
algorithm to design the consensus dynamics. 

I. Introduction 

Consensus algorithms have been recognized as an important step in a variety of decentralized and 
distributed algorithms, such as the rendezvous problem, distributed convex optimization or distributed 
sensing. We pose and solve in this paper what we term the weighted consensus problem over a directed 
graph. Specifically, given a set of positive weights assigned to the agents, we say that the agents reach 
a weighted consensus if they converge to the weighted average of their initial conditions - a formal 
definition to be given shortly. As is commonly done, we assume that the information flow in the system 
is described by a directed graph. Our goal is to determine which weighted averages can be computed 
for a given information flow. Furthermore, we describe how the agents can communicate over the graph 
to design the dynamical system whose evolution reaches the desired weighted consensus. Computing a 
weighted average rather than a simple average is a natural one when the agents in the system are not all 
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on equal footing. For example, think of a rendezvous problem where the rendezvous position depends 
on the initial positions of only a small group of agents; of distributed sensing, where the weighting can 
be proportional to the accuracy of the sensing device, or of opinion dynamics, where participants may 
have different levels of influence on the decision process. Because of their broad relevance, a fair amount 
is already known about consensus algorithms. Indeed, questions concerning sufficient and/or necessary 
conditions for agents to reach consensus ([l]-[9]), questions concerning time delay ([3], [4]), consensus 
with quantized measurements ([10], [12]), consensus with time varying network topologies ([l]-[9]), and 
questions about convergence rate ([11]-[14]), robustness ([15],[16]) in the presence of an adversary have 
all been treated to some degree. 

Broadly speaking, the problem we address in this paper is one of feasibility of an objective given de¬ 
centralization constraints. Similar questions, but involving controllability of linear systems [23], stability 
of linear systems [24] and formation control [25] have also been investigated. While the general problem 
of feasibility of an objective under decentralization constraints is far from being completely understood, 
we shall see that a fairly complete characterization can be obtained in the present case, in the cases 
of both discrete- and continuous-time dynamics. However, still open questions remain, such as: How to 
handle negative weights? How to handle time-varying information flow graphs? How to make sure that 
no-agent can “game the system” and increase or decrease its assigned weight? 

We next describe the model precisely. We assume that there are n agents Xi,... ,Xn evolving in IR'^, and 
that the underlying network topology is specified by a directed graph (or simply digraph) G = {V,E), 
with V = ,n} the set of vertices and E the set of edges. We let Vf be a subset of V comprised 

of the outgoing neighbors of vertex i, i.e.. 


vr := {jeV\i^je E} 


and we assume in this paper that each agent %,■ can only observe its outgoing neighbors. The equations 
of motion for the n agents Xi,... ,Xn are then given by 



Y, Uij-{Xj-Xi), fi = l,...,n 
jevr 


( 1 ) 


with each fl/y a non-negative real number, which we call the interaction weight. 

The objective of the system is characterized by positive real numbers Wj. We define the objective 
function f : ^ as: 

n 

f{Xi,...,Xn) := YjWiXi. 

i=l 



The feasibility question we ask is the following: given a digraph G = {V,E), and a weight vector 
IV = {wi,. ..,Wn) in R”, does there exist a set of non-negative interaction weights {fl/y | / — )■ / G E} 
such that for any initial condition Xi{0),... ,Xn{0) in R'^, all agents will converge to the same point in 
R^ specified by the objective map, i.e., 

lim Xi{t) = /(xi(0),...,x„(0)) 

t—>oo 

for all i = In other words, we require that all the agents not only reach consensus, but also 

converge to a specific point which is a weighted sum of the initial positions of the agents. In the following 
section, we will convert this problem to one of asking whether there exists a sparse, infinitesimal stochastic 
matrix A with a fixed zero pattern (specified by the digraph) such that A has a simple zero eigenvalue 
with the vector w being the corresponding left eigenvector. 

In the paper, we will provide a complete answer to the question of weighted consensus within model (1). 
In particular, we will characterize not only the set of objective maps which are feasible by choices 
of interaction weights, but also the set of interaction weights for a feasible objective map. Note that 
the problem of evaluating averages in a distributed manner has also been handled using discrete-time 
dynamics [17]-[20]. 

The paper is organized as follows. In section II, we introduce some definitions and state the main results 
of the paper. Precisely, the main theorem characterizes the set of objective maps that can be realized 
over a given network topology. Section III is devoted to the proof of the main theorem. In Section VI, 
we present a decentralized algorithm for finding a set of interaction weights associated with a feasible 
objective map. In particular, we relate the set of interaction weights to solutions of graph balancing. We 
provide conclusions in the last section. The paper ends with an Appendix. 

II. Definitions, Problem Reformulation and 
The Main Theorem 

In this section, we introduce the main definitions used in this work, formulate the weighted consensus 
problem in precise terms, and state the main result of the paper. 

A. Background and Notation 

We consider in this paper only simple directed graphs, that is directed graphs with no self loops, and 
with at most one edge between each ordered pair of vertices. We denote by G = {V,E) a directed graph 
where V is the vertex set and E the edge set. We denote by i j an edge of G, with i and j the 



start-vertex and the end-vertex of the edge, respectively. A vertex r is said to he a root of G if for all 
i G V, there is a path from i to r . We say that G is rooted if it contains a root. Graphs with only one 
vertex are hy convention rooted. We denote hy Vr dV the set of all roots of G. The digraph G is strongly 
connected if, for any ordered pair of vertices (h/), there is a path from i to j. In this case, all vertices 
of G are roots, i.e., Vy = V. It is well known that if the digraph G associated with system (1) is rooted, 
then all agents converge to the same state for all initial conditions (see, for example, [6]). Conversely, if 
for any initial condition, all agents of system (1) converge to the same state, then the underlying digraph 
must he rooted. Hence, we only consider rooted digraphs as the underlying digraphs of system (1). For 
a subset V C V, we call G' a subgraph of G induced by V if G' = (V',E') and E' contains any edge 
of E whose start-vertex and end-vertex are in V'. We have the following definition: 

Definition 1 (Relevant Subsets). Let G = {V,E) be a rooted digraph, and V be a subset ofV. We say 
V' is relevant to G (or simply relevant) if it satisfies the two conditions: 

a) . The set V is contained in the root set Vy; 

b) . The subgraph G' induced by V is strongly connected. 


For G a digraph with n vertices, we can always let V = {1,2, ...,n}. We denote by Sp[l/] the 
(n — 1) -simplex contained in R” with vertices the standard basis vectors ei,... ,eyi G R”. For V' C V, 
we define similarly Sp[y^] as fhe convex hull of {c; \ i G Vy. 

Sp[y'] := I X!) I «;• > 0, X] ft; = 1 I . 

[ieV ieV ) 

We use fhe nofafion Sp(l/') fo denofe fhe interior of Sp [!/']: 

Sp(y') := I X!) I «/ > 0, X] a; = 1 I . 

[ieV ieV ) 

If V' is comprised of only one verfex, say verfex i, we fhen sef Sp[y'] = Sp(y^) = {c;}. We infroduce 
a similar nofafion fo denofe a convex cone. Lef C,, for i = 1,.. .,Z, be vectors in R'”; we denofe fhe 
convex cone spanned by C, by 


We denofe ifs inferior by 


Co[Ci,..., Q] := I X3 ft/Q I «/ > 01 . 


Co(Ci,.. .,C/) |X3«/Q I «/ > 0 1 . 


Definition 2 (Sparse Infinifesimal Sfochasfic Mafrix). We say a matrix A is an infinitesimal stochastic 
matrix (ISM) if its off-diagonal entries are non-negative, and its rows sum to zero. Let G be a digraph 



with n vertices. We let A.q be the set of n-by-n ISMs with the following properties: A = [a^) G Ag if 
for i 7^ j, we have 

{ >0 if i ^ i is an edge of G 
= 0 otherwise 

If G consists of only one vertex, then A.q = {0} is a singleton. 

Let 1 be a vector of all ones in R”; then for each matrix A in A.q, we have A1 = 0. So each matrix 
A has at least one zero eigenvalue. Furthermore, it is well known that if A is an ISM, then the real 
parts of eigenvalues of A are non-positive. In particular, if the digraph G is rooted and ttij > 0 for each 
i ^ i E E, then the matrix A has a simple zero eigenvalue. 

B. Main Results 

We start by formulating the targeted consensus problem in view of the facts introduced above. First, 
note that we can rewrite (1) into a matrix form as follows: Let X be an n-hy-d matrix with xj the /-th 
row of X. Then, system (1) is equivalent to 

X = AX (2) 

with matrix A contained in Ag. For the purpose of reaching consensus, we require that the matrix A 
have a simple zero eigenvalue. Let lu E Sp[l/] be the left eigenvector of A corresponding to the zero 
eigenvalue. Then, for any initial condition X(0), we have 

lim X(t) = 1 ■ w^X(O) 

t^oo 

If we write w = (wi,... ,Wn), then 

n 

lim xft) = Y'wixfO) 

t—>oo *“( 

1=1 

Conversely, if the expression above holds for all initial conditions, then the matrix A must have m as a 
left eigenvector and zero as a simple eigenvalue. We thus introduce the following subset of A.q: 

Definition 3 (m-Feasible Dynamics). Let w E Sp[y]. We define the set o/zu-feasible dynamics Kg{w) C 
Aq as the set of ISMs satisfying: 

1) The matrix A has a simple zero eigenvalue. 

2) The vector w is the left eigenvector of A corresponding to the zero eigenvalue, i.e., A^w = 0. 

So the question we raised in the first section can be restated as follows: For a given digraph G and a 
vector w E Sp[y], is the set A.q(w) empty? We answer this question in Theorem 1: 



Theorem 1. Let G = {V,E) be a rooted digraph, and Vi, ... ,Vq be the relevant subsets of G. Let W 
be a subset of Sp[V] comprised of vectors w for which A.q{w) is nonempty. Then, 

w = utiSp(v;). 

We now consider briefly the case of discrete-time dynamics and show that essentially the same result 
holds. To be precise, we consider the model 

X{k + 1) = AX{k) 

where A is a stochastic matrix (i.e. its entries are all non-negative and the sum of the entries in any 
given row is one.) Of course, the matrix A is also a sparse matrix, with the zero pattern specified by 
the rooted graph G = {V,E). For simplicity, we assume that G has self-loops, i.e., i ^ i E E for all 
i G V. Thus, each diagonal entry of A is allowed to take a positive value. Similarly, we let Ag be the 
collection of the sparse stochastic matrices associated with G, and let Ag(m) C Ag be such that each 
A G Ag(m) has a simple eigenvalue 1 with A^iv = w (note that if A is another eigenvalue of A, then 
|A| < 1 by the Perron-Frobenius theorem). 

Theorem 2. Let G = {V,E) be a rooted digraph with a self-loop at each vertex. Let Vi,...,Vq be 
the relevant subsets of G. Let W be a subset of Sp[y] comprised of vectors w for which Ag(m) is 
nonempty. Then, 

W = ul,Sp{Vi). 

Proof. Let G be the digraph G with self-arcs removed, and let W be the set of w for which Ag (m) is 
non-empty. We prove Theorem 2 by showing that W = W and then appealing to Theorem 1. We first 
pick m G W and let A G A.q(w). For sufficiently small e > 0, we have (I -f eA) G A.q(w). Thus, 
W C W. Conversely, let m G W and A G A.q(w), then (A — 1) G A.q(w). Thus, W <Z W. This 
completes the proof. ■ 

The next section is devoted to the proof of Theorem 1 and is organized as follows. In section III-A, 
we focus on the relevant subsets of V. In particular, we show that if the set A.q{iu) is nonempty, then 
the vector lu has to be in the union of Sp(Vi),..., Sp(y(j). In section III-B, we investigate m-feasible 
dynamics without the requirements that G be rooted and that A has zero as a simple eigenvalue. With this 
relaxation, we prove that all the relaxed m-feasible dynamics form a closed convex cone. In section III-C, 
we assume that G is strongly connected, and introduce the notion of principal subset to characterize 
AG(tf). In particular, we provide a canonical decomposition of A.q{w) into disjoint subsets. Moreover, 



we show that the closure of A.q{w) is the closed convex cone of the relaxed w-feasihle dynamics. We 
then combine these results and prove Theorem 1 in section III-D. 

III. Relevant Subsets of Vertices, Cycles of Digraphs and Principal Subsets of 

Cycles 

A. On Relevant Subsets 

We derive here some preliminary relations between the set of m-feasible dynamics A.q{w) and the 
relevant subsets of G introduced in Definition 1. To this end, we set 

14 , := {i € y I Wi / 0}. (3) 

We establish the following result: 

Proposition 3. Let G = (V,E) be a rooted digraph, and w be a vector in Sp[y]. If A.q{zv) is nonempty, 
then 14 , is a relevant subset of G. 

The proof of Proposition 3 proceeds by first showing that the subset is contained in the root set 
Vy of G, and then showing that the subgraph Gjy, derived by restricting G to 14, is strongly connected. 
This is done in Lemmas 4 and 5 below. 

Lemma 4. Let G be a rooted digraph, and w be a vector in Sp[y]. If Jh.Q{w) is nonempty, then 14 
a subset of Vy. 

Proof Without loss of generality, we may assume that the root set Vy consists of the first m vertices. 
Then, each matrix A in A.q is a lower block-triangular matrix, i.e., 

/An 0 \ 

A=\ ] (4) 

y^2i ^22 J 

with An an m-hy-m square matrix and An a zero block. Indeed, if 7 ^ 0 for 1 < f < m, then i j 
is an edge of G, and since i is a root, then so is j. 

In view of the above, the exponential exp(Af), as the state transition matrix of system (2), is also a 
lower block-triangular matrix with blocks of the same dimensions as the blocks of A. Furthermore, since 
the matrix A has a simple zero eigenvalue while all of its other eigenvalues have negative real parts, we 
have 

lim exp(Af) = 1 • 

t^ca 


( 5 ) 



Using (4) and (5), we know that W/ = 0 for all f = m + 1,..., n. This proves the result. 


We now show that the subgraph Gw is strongly connected. 

Lemma 5. Let G be a rooted digraph, and w be a vector in Sp[U]. If A.q(w) is nonempty, then the 
subgraph Gw is strongly connected. 

Proof. As in the proof of the previous lemma, we may assume without loss of generality that the set Vw 
consists of the first m vertices of G. Let A he a matrix in A.q{w), and partition A into blocks as 

All ^12 
All ^22 

with All being an m-hy-m matrix and correspondingly, partition w into 

w = {w',0) 

with lu' a vector in R”*. By assumption, each entry of w' is nonzero. Since A is in Ps.q(w), we have 
A^w = 0, so then Aj 2 to' = 0. Because each entry of A 12 is non-negative and each entry of zv' is 
positive, we must have A 12 = 0. This then implies that An is an m-hy-m ISM. 

Let G' = {V,E'), with V' {1,.. .,m}, be a subgraph of G induced by the block matrix An, i.e., 
an edge i —> j is in E' if and only if fl/y > 0. It suffices to show that G' is strongly connected. To do 
this, note that the digraph G' must be rooted because otherwise An, and hence A, has at least two zero 
eigenvalues. Now, suppose that G' is not strongly connected, then the root set of G', denoted by Vf is 
a proper subset of V'. On the other hand, if we let lA, be the collection of indices of nonzero entries of 
w', then lA, = V'. But, from Lemma 4, we know that 

v = fA, C y; c V' 

which is a contradiction. Thus, we conclude that G' is strongly connected. This completes the proof. ■ 

By combining Lemmas 4 and 5, we establish Proposition 3. We conclude this section by describing 
the relevant sets of some families of digraphs, namely cycle graphs and complete graphs. 

Corollary 6. Let G be an n-cycle. If Jh.Q{w) is nonempty, then either w = e, for some i = 1,... ,n or 
w has no zero entry. 



Proof. If G is a cycle, then G is strongly connected. On the other hand, there is no proper subgraph of 
G, other than a single vertex, which is strongly connected. ■ 



Corollary 7. Let G be a rooted digraph, and let W be the set of vectors in Sp[y] with Ag(w) being 
nonempty. IfVJ = Sp[y], then the digraph G must be a complete graph. 


Proof. It suffices to show that each induced subgraph of two vertices is a 2-cycle. Let 



Then, the set of nonzero entries of w is given hy 

Vw = {hj} 

So hy Proposition 3, the set I 4 , is relevant. In particular, the subgraph G^ is strongly connected, and 
hence a 2-cycle. ■ 

B. On Cycles of Digraphs 

In this sub-section, we assume that G = (V", E) is an arbitrary digraph. Note that if G is not rooted 
and w G Sp[y], then Ps.q(w) is empty since no matrix in Aq has zero as a simple eigenvalue. We thus 
relax this condition in the following definition: 

Definition 4 (Relaxed m-Feasible Dynamics). Let w G Sp[y]. We define the set 0 / relaxed m-feasible 
dynamics Kq{w) C Aq as follows: 

Aq{w) := {A G Aq I A^w = 0} 

Our goal in this sub-section is to characterize the set Aq(w). This is important because as we will 
see later when G is strongly connected, the set Aq{w) is the closure of Aq{iu). 

We say that a digraph G' is a cycle of G if G' is a subgraph of G and is a cycle with at least two 
vertices. We label the cycles of G as Gi,.. .,Gj^. Let lu be in Sp(y). So then, each entry lUj of w is 
positive. For each cycle G, of G, we now define an associated ISM C, by specifying its off-diagonal 
entries. Let be the jk-th entry of Cj, and let 

{ 1 / Wj if y —)• /c is an edge of G, 

( 6 ) 

0 otherwise 

Its diagonal entries are set so that the entries of each row of C, sum to zero. We establish the following 
result in this sub-section. 



Proposition 8. Let G be a digraph, and w be a vector in Sp(y). Let Gi,... ,0^ be the cycles of G, 
and Cl, be the associated ISMs. If k > 1, then the set A.q{w) is a convex cone spanned by 

Cl, ■ ■ ■ ,Ck, i.e., 

Ag{w) = Co[Ci,- • ■ ,Ck] 

Moreover, each ray {aC, | a > 0} is an extreme ray of the convex cone. 

By convention, if A: = 0, we set Aq(w) = {0}. We note here that a similar result relating cycles and 
douhly stochastic matrices can he found in [21]. We prove Proposition 8 hy first investigating a special 
case where G is acyclic, i.e., there is no cycle contained in G. 

Lemma 9, Let G be an acyclic digraph, and w be a vector in Sp(y). Then, P^.Q{w) = {0}. 


Proof. We prove the lemma hy induction on the number n of vertices of G. 

Base case. If G consists of only one vertex, then there is nothing to prove. 

Inductive step. Suppose the statement of the lemma holds for n, we show that it holds for n + 1. 

Since G is acyclic, there must exist a vertex, say vertex 1, with no incoming edge. Let A € A.g(w), 
and let fli he the first column of A. Then fli has at most one nonzero entry, i.e., the first entry of fli. Let 
flu be the first entry of fli, then 

ajw = W\a\i = 0. 


Since W\ is positive by assumption, we then have flu = 0. This then implies that the first row vector of 
A is also a zero vector. Hence we can write A as 


(::) 


with A' an n-by-n matrix and V' = {2,... ,n + 1} the corresponding vertex set. It now suffices to show 
that Af is a zero matrix. 

Let w' be a vector in R” defined by 

w' := — (tV2,...,w„+i). 

i — 

Note that w' is well defined since tui < 1. By construction, we have w' G Sp (!/'). Moreover, w' satisfies 
the condition that A'"^ w' = 0. Let G' be a subgraph of G induced by V'. Let Ag/ be the set of sparse 
ISMs associated with G', and let 


Actiw') |a' G Aq/ I A'^iv' = o| 



Then, A' G Aq/(w'). Since the subgraph G' is acyclic, we conclude hy the induction hypothesis that 
Kqi{w') contains only the zero matrix, and hence A' = 0. This completes the proof. ■ 

We now prove Proposition 8. 

Proof of Proposition 8. We first show that Co[Ci,- • • ,Cjt] C A.q{w). It suffices to show that each Q 
is contained in AQ(m). Denote hy Vj the j-th column of Q; then either Vj is a zero vector or Vj contains 
two nonzero entries. If Vj is a zero vector, then vJzv = 0, so we focus on the latter case. By definition 
of Ci, the j-th entry of Vj is —\/wj. We assume without loss of generality that the other nonzero entry 
of Vj is the A:-th entry; its value is then given hy l/tujt- Then, 

vJW = ZVj ■ { — 1/Wj) + tUjt • (1/Wfc) = 0. 

This equality holds for each column vector of C/, and hence Cj w = 0. 

We now show that A.q{w) C Co[Ci,- • • ,Q]. To this end, fix a matrix A in A.q{w). Assume that 
there is a cycle G, = {Vi,Ei) in G such that flyjt > 0 for nil / —> A: G Ej. We show helow that if this is 
not the case, A is necessarily the zero matrix. First, note that there exists an a > 0 such that {A — nC/) 
is also an ISM; indeed the matrix A — aCj is in AQ(m) hecause 

{A — oiCi)^w = A"^w — kCJ w = 0. 

Now let 

Kj max ja G IR | {A — ocCj) G AQ(a;)| , 
which can he computed explicitly as 

= min I / ^ TJ/j —> A: G . 

Let A' := A — (XiCj, then A' has more zero entries than does A. To see this, it suffices to check the 
off-diagonal entries of A'. First note that if the jk-th, j k, entry of A' is positive, then so is the jk-th 
entry of A. Thus, A' has at least as many zero entries as A does. Now let 

j ^ k e argmm{iUjajj^ \ j G Vi,j k E E,}. 

Then, the jk-th entry of A' is zero hecause 

^jk ^jk {^jktjk)^i,jk kljk {zVjUjfjl/lVj 0 . 

On the other hand, we have Ujj^ > 0. Thus, A' has more zero entries than does A. We then say that the 
matrix A' is a reduction of A. Now let 



be a chain of reductions. Since has more zero entries than does, the chain must be finite. 

Suppose that this chain stops at A, i.e., there does not exist a reduction of A. It then suffices to prove 
that A is a zero matrix. Let G be a digraph with n vertices induced by the matrix A. Since there is no 
reduction of A, the induced digraph G must be acyclic. Since A^w = 0 with zv G Sp(y), by Lemma 9, 
we have A = 0. 

It now remains to show that each ray {aCj | a > 0} is an extreme ray of the convex cone Ac(m). 
We show that for each matrix G/, there does not exist a set of non-negative coefficients tty’s such that 

Q = 

i^i 

We prove by contradiction. Suppose that the expression above holds; then at least one coefficient tty, for 
i 7 ^ i, is positive. Hence, the cycle Gy is a subgraph of G/. On the other hand, G/ itself is a cycle, so we 
must have G, = Gy, which is a contradiction. This completes the proof. ■ 

C. On Principal Subsets 

In this section, we assume that G = (V, £) is a strongly connected digraph with n vertices for n > 1. 
Let Q = {Gi,..., G]^} be the set of cycles of G; ^ is non-empty since for each edge i —7 y of G, there 
is at least one cycle containing that edge. Recall that a Hamiltonian cycle of G is a cycle that passes 
through every vertex. We can thus say that this cycle strongly connects the graph, in the sense that each 
vertex is connected to every other vertex using only edges in the cycle. If G does not have a Hamiltonian 
cycle, one can nevertheless use several cycles to strongly connect G. We make this formal through the 
introduction of principal subset of Q. In words, these are sets of cycles of G that strongly connect G. 
Specifically, we have the following definition: 

Definition 5 (Principal Subset). Let G be a digraph and Q = {Gi,...,Gfc} be its set of cycles. Let 
Gj = {Vj, Ej). We call a subset {G[,..., G^} of Q principal if the graph 

G' = (y,u,-E') 

is strongly connected. We label the principal subsets of Q as Q\,..., Qp. 

Let Qi = {G/j, ..., G/^} be a principal subset of Q. Fix a vector w G Sp(y), and let G^,..., Gj^ be 
the associated ISMs (defined in (6)). Recall that 



is the convex cone spanned by Cj^,, Cj^, and Co(Qj,..., Q^) is the interior of Co[Qj,..., Q^]. 
With a slight abuse of notation, we write 

ColGi] := Co[Qj,...,Q^], 

and 

CoiGi) := Co(Qj,...,Q„). 

Equipped with definitions and notations above, we now prove the following result: 

Proposition 10. Let G be a strongly connected digraph with n vertices for n > 1, and let Qi,... ,Qp 
be principal subsets of G- Let w G Sp(l/). Then, 

Ag{zv) = U^^^^Co{Gi). 

Proof. We first show that each set Co{Gi) is contained in Aq{iu). Suppose that Gi is comprised of 
cycles Gq,...,G/^. For any matrix A in Co{Gi), there exists a set of positive coefficients ai,...,Kfn 
such that 

m 

A = ^ oijCi. 

;=i 

Let Ga be the digraph induced by matrix A; then Gj^ is strongly connected by definition of Gi- 
Consequently, the matrix A has a simple zero eigenvalue. Furthermore, we have 

G,^m = 0 

for all y = 1,..., m. So then, A^w = 0, and hence A G Ag{iv). We have thus proved that Co(^;) is 
contained in Aq{w). 

Next we show that the set Aq (m) is contained in the union of Co(^i),..., Co(Gp). Let A be a matrix 
in Aq{w)', then A is also contained in Ac(m). Thus by Proposition 8, there is a set of non-negative 
coefficients ai,... such that 

k 

A = Y,XiCi (7) 

i=\ 

Suppose nq,..., are the non-zero coefficients out of Oii, ..., a^-, we then let G' '■= {Gq,..., Gj^}. We 
need to show that G' is a principal subset of G- Let Gj^ be the digraph induced by A. It follows from (7) 
and (6) that Ga is the union of Gq,...,G/^. It now suffices fo show that Ga is strongly connected. 
Suppose that it is not the case; then by Proposition 3, the set Aq{w) is empty because 14; = L which 
is not a relevant set of G^. On the other hand, A G Aq{w), which is a contradiction. Hence, Ga is 
strongly connected, and thus G' is a principal subset of G- H 



We note that in general, the right-hand-side of the decomposition of A.q{zv) given in Proposition 10 
may contain redundant terms. Indeed, we might have for some i that 

CoiGi) c Uj^iCoiGj) 

To rule out this redundancy, we introduce the following definition: 

Definition 6 (Minimal Cover). For a collection of arbitrary sets let A = We say that 

Ai^, ... ,Ai^ is a minimal cover of A with respect to the collection if 

A = u\.Ai. 

and I is the least integer for the relation above to hold. 

For the collection of sets Co(^l),.. .,Co(^p), it should he clear that the minimal cover of Pi.Q{w) 
always exists. We now show that, quite surprisingly, there exists a unique minimal cover of JAq{w) and 
its components are pairwise disjoint. To do so, we define a partial order over the set of principal subsets 
as follows: let us introduce the notation 

Gi y Gj if Co{Gi) 2 Co{Gj). 

A principal subset G' is said to be a maximal element with respect to the partial order if there does 
not exist another principal subset G" such that G" >- G' ■ We label G\, ■ ■ ■ /G* as the maximal elements. 
With the definitions above, we establish the following result. 

Proposition 11. The sets Co{Gl),.. .,Co{Gf) are pairwise disjoint. Moreover, 

AgH = Co(^i*)U...UCo(Clf) (8) 

is the unique minimal cover of A.q{w). 

To prove Proposition 11, we first establish the following fact: 

Lemma 12 . If Gi A Gj, then Gi 2 Qj- 

Proof. It suffices to show that Gi 3 Gj- Suppose it is not the case, and that there exists a cycle Gjt such 
that Gfc (^Gj-G j. By Proposition 8 , | a > 0} is an extreme ray of jAq[iu). This, in particular, 

implies that Cjt ^ Co[^;]. On the other hand, if Gi F Gj, then Co[^/] ^ Co[^y]. But then. 


Cfc G Co[Gi] - Co[Gj] = 0 



which is a contradiction. This completes the proof. 


The converse of Lemma 12 is not true in general, i.e., we may not conclude that Qj >- Qj from the 
condition that Qi 2 Qy However, we will he able to prove that if Qi 2 Qj, then either Qi y- Qj or 
CoiQi)nCoiQj) =®. 

For a given principal subset Q' = {G/j,..., G/^}, we denote by 

{ m 

;=i 

the linear space spanned by the matrices {Cy,.. Note that each Co{Qi) is an open subset of 

L{Qi). It should be clear that if Qi ^ Qj, then L{Qi) ^ L{Qj). Furthermore, we have the following fact: 

Lemma 13. Assume that Qi 2 Qj, and let Q' := Qi — Qj. Then, the following three properties hold: 

1. If L{Qi) = L{Qj), then Qi y Qj. 

2. If L{Qi) 2 L{Qj) and Co{Q') n L{Qj) / 0, then Qi y Qj. 

3. If L{Qi) 2 L{Qj) and Co{Q') n L{Qj) = 0, then Co{Qi) n Co{Qj) = 0. 

We refer readers to the Appendix for a proof of Lemma 13. We are now in a position to prove 
Proposition 11. 

Proof of Proposition 11. First we show that Relation (8) holds. Since the Q*’s are maximal elements, 
each set Co{Qj), for j = 1,..., p, is contained in some Co(^*) for f = 1,..., /■ By Proposition 10, we 
have that 

Ag(w) = Co(^i) U ... U Co{Qp), 

from which (8) follows. 

Next, we will show that the sets Co(^^),... ,Co(^;*) are pairwise disjoint. We prove this by contra¬ 
diction. Assume that there is a matrix 

AeCo{Q*)r\Co{QI), for//;. 

Set Q' := Q* U Q*. It is not hard to see that A G Co(Q'). Indeed, if we let Q* = {Gy,..., Gi^} and 
QJ = {Gj^,..., Gj then there are positive coefficients a,;’s and fijfs such that 

m m' 

t=l S=1 

Using the previous equation, we can express A as 



which shows that A G Co(O'). Since the are distinct, we have Q' 2 and/or A QJ. We assume 
without loss of generality that the former holds. By Lemma 13, either g' y- g* ovCo{g')nco{g*) = 0 . 
But since 

A^co{g')nco{gi), 

we conclude that g' y g* which then contradicts the fact that g* is a maximal element. Thus, we have 
proved that Co(t?^),... ,Co(^^*) are pairwise disjoint. 

It now remains to show that ( 8 ) is a minimal cover, and indeed it is the unique minimal cover. Let 
{g^, ■ ■ ■ ,gl/} he any set of principal subsets such that 

Ag(w) = Co(^l{) U ... UCo(^?;',) (9) 

is a minimal cover of A.q(w). Then, we have I' < 1. 

Now to each ^•, we can assign a maximal element in g. G {g^,.. .,gf} such that g' y g-. We claim 
that any such assignment has to satisfy the condition that if i ^ j, then 7 ^ g'j. To see this, note that 
for any pair g-, gj, there is no principal subset g' such that g' y g- and g' y g'-. Indeed, if it were 
the case, then Co(^-) UCo(^p C Co(ty') and we can replace Co(^-) UCo(^p with Co{g'), which 
contradicts the assumption that (9) is a minimal cover of A.q{w). 

Since g( 7^ gj for all i 7^ j, we can assume, without loss of generality, that = g* for all i = 1,..., 

It should be clear that 

co(g') c co{g*) 

and by Lemma 12, the equality holds if and only if g- = g*. Since Co(f/j^),.. .,Co(^P are pairwise 
disjoint; we thus conclude that 

co{g[) u... u co{g'y) c co(^i*) u... uco(^;) 

and the equality holds if and only if 

{ej.ff,'.} = {e;.e;}. 

In other words, we have shown that ( 8 ) is the unique minimal cover of Ag(w). ■ 

We conclude this sub-section by relating Ag(iu) to A.q(w)\ 

Proposition 14. Let G be a strongly connected digraph, and w be a vector in Sp(y). Then, A.q{w) is 
a nonempty convex set and its closure is A.q{w). 



Proof. If G consists of only one vertex, then A.q{iu) = A.q{w) = {0}. Henceforth, we assume that the 
number of vertices of G is greater than one. 

We first show that A.q{w) is a convex set. Let Aj and Aj he two matrices in Co{0i) and Co{Qj) 
respectively; we show that for and ocj positive, the matrix a/A,- + ocjAj is contained in A.q{iu). First 
note that the matrix a,A, + ajAj is an element in Co{0i U Qj). Since Qj U Qj is a principal subset, 
OijAi + ajAj is contained in A.q{w). 

It now remains to show that the closure of A.q{iu) is ^q{w). First we note that A.q{w) is contained 
in Ac(m) while JAq{w) is a closed set. So the closure of A.q{w) must be contained in We 

now show that the converse is also true, that is Ag(m) is contained in the closure of A.q{iu). Choose 
a matrix A in — A.q{w)', then by Proposition 8, we have 

k 

A = (XjCj 

i=l 

with each non-negative. Since for each positive real number e > 0, the matrix 

k 

M^) ■= ^i‘>^i + £)Ci 

i=l 


is contained in A.q{w), A is in the closure of A.q{iu). This completes the proof. 


D. Proof of Theorem 1 

We now return to the proof of Theorem 1 stated in Section II. 

Proof of Theorem 1. Recall that Vi,...,Vcj are the relevant subsets of G, and Sp(VJ) C Sp[y] is the 
interior of the convex hull spanned by the unit vectors {ej \ j G Vj}. Also recall that W is the set of 
vectors lu in Sp[l/] for which A.q(zv) is not empty. 

From Proposition 3, we know that if A.q{iu) is not empty, then I 4 , (defined in (3)) is relevant and 
thus, the set W is contained in the union Sp(VJ). We now show that the converse is also true. Let 
V' be a relevant subset of V, and for simplicity, assume that V' = {1,... ,m} with m < n. Let G' be 
the subgraph of G induced by V'-, then by the definition of relevant subset, V is contained in the root 
set of G and G' is strongly connected. Let m be a vector contained in Sp(y^), and let w' be the vector 
in R”* containing the first m entries of w, i.e., lu = {iu',0). 

We now prove that A.q{iu) is nonempty by constructing a matrix A in it. We partition the matrix A 


into four blocks as 


A = 


All ^12 
All ^22 


( 10 ) 



with All m-by-m matrix. Let A.qi{zv') be the set of m-hy-m ISMs associated with the digraph G' 
and the vector lu'. Then by Proposition 14, the set A.q/{w') is nonempty, and hence we can pick An 
in A.qi{w'). Let A12 be the zero matrix. Choose A21 and A22 such that if i —> j is an edge of G and 
if i > m, then the ij-th entry of A is positive. We now show that the resulting matrix A is contained in 
A.q{w). First note that by the choice of An, we have AJ-^w' = 0, and hence A^w = 0. 

It now suffices to show that A has zero as a simple eigenvalue. Let be the digraph induced by 
the matrix A. We will show that Gyi is rooted with root set V. Since An = 0 by construction, there is 
no edge i j with 1 < i < ra and j > m. Thus, for any vertex j ^ V', there is no path in Ga from a 
vertex i E V to ]. So then, the root set of Ga is a subset of V'. On the other hand, each vertex in V 
is a root of G, and by construction of A 21 and A 22 , we know that if i —)■ j, for i > m, is an edge of G, 
then it is also an edge of G^^. Thus, for any vertex i ^ V', there is a path from i to some vertex in V. 
Since the subgraph G' is strongly connected, the set V' is the root set of Ga- Hence, A has zero as a 
simple eigenvalue. This completes the proof. ■ 

Corollary 15. Let G be a rooted graph, and w be such that Pi.Q{w) is not empty. Then, 

1. The digraph Ga induced by any matrix A E Plq{w) is rooted, and 14, is the root set. 

2. The set A.q{zv) is convex. 

Proof. Letting A E A.q(w), we show that Ga is rooted. For simplicity, but without loss of generality, 
we assume that w = (w', 0) with w' E R'” containing the nonzero entries of w. Partition A into blocks 
as we did in (10). Then, An = 0 because A^ 2 ^' = 0- Thus, the root set of Ga is a subset of 14,. On 
the other hand, from Lemma 5, we know that the subgraph Ga, induced by I 4 , is strongly connected. 
Thus, the root set of Ga is 14- 
Now let A' and A" be in A.q(iv), and let 

A := a'A' + a"A" 

with ix' and ix" positive. We show that A E A.q(zv). It should be clear that = 0. It remains to 

show that A has zero as a simple eigenvalue. This holds because the two induced digraphs Ga' and Ga" 
are rooted. Hence, the digraph Ga, as a union of G^/ and Ga", is also rooted. Thus, we conclude that 
A has a simple zero eigenvalue with = 0 and hence, A G A.c{iv). This completes the proof. ■ 

IV. Decentralized Implementation of ^-Feasible Dynamics 

In this section, we will assume that G is a rooted digraph, and m is a vector for which the set A.q{iu) 
is nonempty. We present here a decentralized algorithm that allows the agents to find a matrix A in 



A.q{zv). In particular, we assume that each agent Xj only knows its own weight Wj, and each agent is 
only able to communicate/cooperate with its neighbors, which are defined as the agents connected to i 
with either an incoming or an outgoing edge. 

The implementation of the algorithm derived here relies on decentralized methods for the so-called 
graph balancing problem for the digraph G (referred to as G-balancing). We say that the coefficients 
^ij > 0, for i ^ i E E, form a solution of G-balancing if for each vertex i of G, we have 

E = E h 

kdVE jevr 

with and l/~ being respectively the incoming and the outgoing neighbors of vertex i. We call a 
solution positive (resp. non-negative) if the bij’s are strictly positive (resp. non-negative). 

Lemma 16. Let G be a digraph, and let w be a vector in Sp(y). Let B>o be the set of non¬ 
negative solutions of the G-balancing problem. Let A be a diagonal matrix with A;,- = Wf Then 
B>o = A~'^Ag{u>). 

Proof Let {bij | i —)■ / G £} be a non-negative solution of G-balancing. This solution gives rise to an 
ISM B, i.e., if we let By be the ij-th, i 7 ^ j, entry of B, then 

g.. .= I if ^ ^ y ^ ^ 

^ [ 0 otherwise. 

Since {by | i —> y G E} is a non-negative solution of the G-balancing problem, not only is B an ISM, 
but so is B^. In other words, we have B^l = 0. Let A be a diagonal matrix with w being its diagonal; 
then the matrix A := A~^B is an element in Aq(w) because 

A^w = B^A-^w = B^l = 0 

Conversely, if A is a matrix in Aq{iu), then the matrix B := AjyA yields a non-negative solution of 
G-balancing. Moreover, this map between B>o and jAq{iu) is one-to-one and onto because the diagonal 
matrix A is invertible. ■ 

Remark 1. It is known that G is strongly connected if and only if there exists a positive solution of 
G-balancing. We also note that for G strongly connected and {bjj | / —> / G E} a positive solution of 
G-balancing, the matrix A = A~^B is contained in AQiiv). 

Now suppose that G is strongly connected, and lu is in Sp(l/). Suppose that there is a decentralized 
algorithm to find a positive solution {bjj | / —> / G E} of G-balancing. Then by Lemma 16, it suffices 



for each agent x, to set the interaction weights as 


Uij := bij/Wi, 

because the resulting set | i —> / G E} yields a matrix A in A.q{iu). So for G a strongly connected 
digraph and lu a vector in Sp(l/), the problem of finding a matrix A G A.q{w) is reduced to the 
problem of finding a positive solution of G-balancing. This is a well-studied problem, and we provide 
here a decentralized iterative algorithm for agents to find a positive solution of G-balancing 

Algorithm Al: G-balancing for G strongly connected. We let h,y[Z] be the value of by at iteration 
step I > 0. We assume that at every step, the agent Xj knows the values of for all k G and the 
value of bjj for all jevr. 

Initialization. Each agent x, sets Z’y[0] = 1 for all jevr. 

Iterative step. Each agent X/ updates hy[Z] as 

+ = ^ E i’kiV]/\vr 

\ t€V* 

We refer to [22] for a proof of convergence of the algorithm. 

We now consider the case of G rooted, but not necessarily strongly connected. We assume that the 
vector w is chosen so that A.q{w) is nonempty. Eor simplicity, we still assume that only the first m 
entries of iv are nonzero, and let w' be in R'” so that w = {zv',0). Eet G' be the subgraph of G induced 
by the first m vertices, and let 

Aciiv') := |a' G a' I A'^w' = o| 

Similarly, we partition an ISM A into four blocks 

All ^12 
All ^22 

with All being m-hy-m. We will now describe a decentralized algorithm for agents to construct the 
four block matrices Aii,Ai 2 , A 21 and A 22 so that the resulting matrix A is contained in Aq{iv). The 
algorithm, described below, implements the construction of a specific choice of matrix A G Aq{iv) 
given in the proof of Theorem 1; to be precise, we want the blocks Ay’s to be such that 

1. The block matrix An is contained in Aqi{w'). 

2. The block matrix A 12 is a zero matrix. 

3. The two block matrices A 21 and A 22 satisfy the condition that if i —)■ j is an edge of G with i > m, 
then fly, the i/-th entry of A, is 1. 




Algorithm A2: Computing A G A.q(w) for G rooted. We use an iterative method to derive fl/y, but 
since the graph G is not necessarily strongly connected, we need to process the input as described below. 
Initialization. Each agent x, informs his/her neighbors (both incoming and outgoing) of his/her own 
weight Wi, and agent X; receives the information of weights from all of his/her neighbors. There are two 
different cases depending on whether the weight of agent x, is zero or not. 

a) . If Wi = 0, then agent x, sets fl/y[0] = 1 for all jevr. 

b) . If Wj > 0, then agent X/ defines the sets 


' Vl+ := {k G V+ I Wfc > 0} 

We note that V'-^ (resp. V-~) is just the set of incoming (resp. outgoing) neighbors of i in the 
digraph G'. Agent x, then sets 




1/m, if ; G 1^' 
0 otherwise 


Iterative step. We still consider two cases: 

a) . If Wi = 0, then agent X/ retains the value of fly [/], i.e., fly [Z + 1] = fly[Z] = 1 for all jevr. 

b) . If Wi > 0, then agent X/ updates fly[Z] as 


fly [Z + 1] 


1 

2 



^keV. 


t+ 


Wk-akiV] 


Wi-\Vf 


0 


if;Gi^- 

otherwise 


In other words, agent x,- only updates fly[Z] with ; G v;-. 

Note that if we replace fly[-] with bij[-]/Wi, then we actually recover Algorithm A1 and obtain a 
positive solution of G'-balancing. 


V. Conclusions 


In this paper, we have worked with the standard consensus model, and addressed the question of given 
a rooted digraph G, what kind of linear objective map 

n 

f{Xi,...,Xn) = YjWiXi 
i=l 

with w = (mi, ... ,Wn) G Sp[E], is feasible by a choice of interaction weights fly? By introducing the 
notion of relevant subsets of vertices, we have provided a complete answer to this question in Theorem 1 
for the case of continuous-time dynamics, and in Theorem 2 for the case of discrete-time dynamics. We 



illustrated the results on the particular case of circles and complete graphs. In addition, we have also 
dealt with implementation of a feasible ohjective map /. By looking at cycles of G, and introducing 
the notion of principal subsets, we have shown how the set of feasible objective maps / can be related 
to a decomposition of the space of stochastic matrices in Propositions 10, 11, and 14. Finally, we also 
presented a decentralized algorithm for agents in a network to implement a selected set of interaction 
weights that achieves a feasible objective map. 

Future work may focus on the case where the interaction weights fl,y’s are allowed to be negative. Note 
that in the case when fl,y’s are non-negative, the vector iv associated with a feasible objective map has 
to be in the unit simplex. Thus, if / is an objective map with lu ^ Sp[y], and if there is a choice of 
under which / is feasible, then there must exist some Ujj which is negative. The question about feasibility, 
and the question about decentralized implementation can still be raised in this context for a given digraph 
G. Other open problems, such as dealing with time-varying digraphs, dealing with nonlinear objective 
maps, and dealing with the presence of a malicious player who attempts to increase his/her own weight, 
as in [16], are all interesting topics to look at. 
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Appendix 

We prove here Lemma 13 stated in section III-C. 


Proof of Lemma 13. We prove Lemma 13 case by case. 



1) Proof for the case where L{Qj) = L{Qj): We first show that Co{0i) ^ Co (Qj), then show that 
Co{Qi) / Co{Qj). Assume that Qj = {Gi,...,Gni} and Qj = {Gi, with m > m' . Since 

L{Qi) = L{Qj), for each Gg with s > m', there are coefficients (Xst’s such that 

m' 

Cs = '£crstCt ( 11 ) 

t=l 

Now choose a matrix 

m' 

A = ^ KtCt e Co{Qj) 

t=l 

with each oct > 0, and construct positive coefficients j6s’s such that 

m 

a=Y, iSsCs G Co{Gi) 

S=1 

Choose an 6 > 0, and define 


fs := 


Ois-e LT=m>+i ^ts if 1 < S < m' 
e if s > m'. 


Since ttg > 0, we can choose e sufficiently small so that jSg > 0 for all s = 1,... , m. With this choice 
of (fig’s, we have 

m m' m m 

^(6 gCg= ^(«g-e ^ crts)Cs + e ^ Cg 

s=l s=l t=m'+l s=ni'+l 

After rearranging the terms, we obtain 

mm' mm' 

^(figCg= ^ngGg + e ^ (Gg-^o-gfQ) 

s=l s=l s=m'+l t=l 

By (11), we have 

m' m 

A= ^«gCg = ^(figCg GCo(^/). 

S=1 S=1 

Next we show that there exists a matrix A G Co(^;) — Co{Qj). Consider the cycle Gm G Qj — Qj. 
By Proposition 8, {aCm | a > 0} is an extreme ray of j^q{w), and hence, there does not exist a set of 
non-negative coefficients tt/’s such that This, in particular, implies that 


inf { IICm — CII I C G Co[^y]} > 0 

where ||Cm ~ C|| is the trace of (Cm — C)^(Cm — C). In other words, the matrix Cm and the convex 
cone Co[^y] are separable. Thus, if we choose 

m — l 

A := Cm + e Ci E Co{Qi) 

1=1 

for sufficiently small e > 0, then A ^ Co[Qj]. This completes the proof. 



2) Proof for the case where L{Qi) 2 ^{Qj) Co{Q') nCo(^y) 7 ^ 0; We first show that Co(^,) ^ 
(Zo{Qj), and then show that Co{Qi) 7 ^ Co(^y). Let Qj = {Gi,... ,Gm} and Qj = {Gi,...,G^/} with 
m > m'. Choose a matrix 

m' 

a=Y, octCt e Co{Gj) 

t=i 

and construct positive coefficients jSs’s such that 

m 

a=Y, fsCs e Co{Gi) 

S=1 

Since Co(^') intersects L{Qj), there are positive coefficients j 6 s’s and coefficients 'yfs such that 


£ fsCs = '^7tCteL{gj 


( 12 ) 


s=m'+l 


f=l 


Now choose a positive number e, and define 

/ 

OLs — ejs if 1 < s < m' 
efs if s > m 

Then, for sufficiently small e, we have j 6 s > 0 for all s = 1,..., m. By the choice of ffs, we have 

mm' m 

^/3sQ= E(«s-^Ts)Cs+ E h- 

s=l s=l s=m'+l 

After re-arranging the terms, we have 

m m' ! m m' \ 

^fsCs = ^iXsCs + e( ^ fsCs-^JsCs] 


S =1 


S = 1 


^s=m'+l 


s=l 


By (12), we have 

m' m 

A=Y,0CsCs = Y,^CseCo{Gi). 

S=1 S=1 

Next, we show that there exists a matrix A G Co(^/) — Co(^y). Note that Go{Gi) is an open set in 
L{Gi) and, hy assumption, dim L(^,) > dim L{Gj). Thus, there must exist a matrix A G Co{Gi) — L{Gj) 
which implies that A G Co(^,) — Co{Qj). 

3) Proof for the case where L{Qi) 2 Co{Q') r\Co{Gj) = 0; We prove this case hy 

contradiction. Assume that there exists a matrix A such that 

m' m 

A = ^ octGt = Y, i^sCs G Co(^,-) n Co(^y) 

t=\ S=1 

for some positive coefficients 0Lt’s> and /Ig’s. Then, 

m m' 

Y fsCs=Yi‘>^t-ft)CteCoig')nL{gj) 
s=m'+l s=l 

which is a contradiction. This completes the proof. ■ 



